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Abstract 

We are interested in constructing concrete independent events in 
purely atomic probability spaces with geometric distribution. Among 
other facts we prove that there are uncountable many sequences of 
independent events. 



1 Introduction 

Let us assume a fixed ratio r is given, r € (0,1). In wliat follows we will 
work with the discrete probability space No = {0,1,2,3,...} and the usual 
geometric probability on A (all subsets of No) defined by 

Pr{E) := for every set E ^ A. 

^ k&E\{0} 

We are interested to study the class of independent sets in this probability 
space. We are going to follow [2j and define: 
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A,B are called independent if P{A n B) = P{A)P{B). 

With this definition for every E C 0,, 0, and E are independent and 
and E are also independent. These are clearly trivial examples. Three or 
more subsets of fi, Ai, An are called mutually independent or simply 
independent if for every choice of k {n > k > 2) such sets, say Aij^,...,Ai^, we 
have 

P{f]A,) = llP{A,). (1) 

So, for n (n > 2) independent sets one needs to have 2" — n — 1 relations 
as in ([1]) to be satisfied. An infinite family of subsets is called independent 
if each finite collection of these subsets is independent. Events are called 
trivial if their probability is or 1. 

If n S N then ^}{n) usually denotes the number of primes dividing n 
counting their multiplicities (see [8.]). In [Ij and [6J, independent families 
of events have been studied for finite probability spaces with uniform dis- 
tribution. Eisenberg and Ghosh [6| show that the number of nontrivial 
independent events in such spaces cannot be more than J7(m) where m is 
the cardinality of the space. This result should be seen in view of the known 
fact (see Problem 50, Section 4.1 in [7]) that if Ai, A2, An are in- 
dependent non-trivial events of a sample space X then \X\ > 2". One can 
observe that in general 0,(m) is considerably smaller than log2 m. It is worth 
mentioning that according to [5] the first paper to deal to this problem in 
uniform finite probability spaces is [9]. In their paper, Shiflett and Shultz [9] 
raise the question of the existence of spaces with no non-trivial independent 
pairs, called dependent probability spaces. A space containing non-trivial in- 
dependent events is called independent. For uniform distributed probability 
spaces X, as a result of the work in [6j and [Ij, X is dependent if \X\ a prime 
number and independent if \X\ is composite. For denumerable sets X one 
can see the construction given in [5J or look at the Example 1.1 in [lOj. For 
our spaces, the Example 1.1 does not apply and in fact, we will construct 
explicitly lots of independent sets. 

For every n G N one can consider the following space of geometric prob- 
ability distribution, denoted here by Qn '■= (Ni^(W))-P) where P{k) = 
with k € [n] := {1, 2, 3, n} and of course q is the positive solution of the 
equation 

n 

Y^q^ = l. 

k=l 
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This space is independent for every n > 4 with n composite. Indeed, if 
n = st with s,t £ N s,t > 2 on can check that the sets A := {1, 2, 3, s}, 
B := {l,s + l,2s + l...,(i — l)s + l} represent non-trivial independent events. 
To match the uniform distribution situation, it would be interesting if Qn 
was a dependent space for every n prime. 

The class of independent sets is important in probability theory for var- 
ious reasons. Philosophically speaking, the concept of independence is at 
the heart of the axiomatic system of modern probability theory introduced 
by A. N. Kolmogorov in 1933. More recently, it was shown in [3] that two 
probability measures on the same space which have the same independent 
(pairs of) events must be equal if at least one of them is atomless. This was 
in fact a result of A. P. Yurachkivsky from 1989 as the same authors of [3j 
point out in the addendum to their paper that appeared in [4]. 

On the other hand, Szekely and Mori [TO] show that if the probability 
space is atomic then there may be no independent sets or one may have 
a sequence of such sets. The following result that appeared in [10] is a 
sufficient condition for the existence of a sequence of independent events in 
the probability space. 

Theorem 1. If the range of a purely atomic probability measure contains 
and interval of the form [0, e) for some e > then there are infinitely many 
independent sets in the underlying probability space. 

Let us observe that, if r = 1/2 the probability space (Nq,^, i-1/2) does 
satisfy the hypothesis of the above theorem with e = 1 because every number 
in [0, 1] has a representation in base 2. On the other hand if, let us say 
r = 1/3, then the range of P1/3 is the usual Cantor set which has Lebesgue 
measure zero, so Theorem [1] does not apply to (No, ^, i-1/3). However, we 
will show that there are uncountably many pairs of sets that are independent 
in (No,^, Pr) for every < r < 1 (these sets do not depend of r). 

2 Independent pairs of events for denumerable spaces 

The first result we would like to include is in fact a characterization, under 
some restrictions of r, of all pairs of independent events {A, B), in which one 
of them, say B, is fixed and of a certain form. This will show in particular 
that there are uncountably many such pairs. In order to state this theorem 
we need to start with a preliminary ingredient. 

Lemma 1. For m > 1, consider the function given by 

fix) = {2x - 1)(1 + x") - X™ for all x G [0, 1]. 
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The function f is strictly increasing and it has unique zero in [0, 1] denoted 
by tm- Moreover, for all m we have tm > 1/2, the sequence {t^} is decreas- 
ing and 

lim tm = -. 



Having tm defined as above we can state our first theorem. 

Theorem 2. For every natural number n > 2, we define the events E :- 
{0, n — 1} and 



B 



{1,2, ...,n — l,2n — 1, 2n, 3n — 3, 



n-l 



n-l 



4n - 3, 4n - 2, 5n - 5, ...}. 



(2) 



n-l 



Also, for T d B an arbitrary nonempty subset we set A := E + T with the 
usual definition of addition of two sets in a semigroup. Then A and B are 
independent events in (No, ^, -Pr)- 

Conversely, if r < tm (where m = n — 1 and tm as in Lemma\^, B is 
given as in ^ and A forms an independent pair with B, then A must be of 
the above form, i.e. A = E -\-T for some T C B. 

Proof of Lemma [H The function / has derivative f'{x) = 2(1 + x™) — 
2m(l — x)x'^~^, X € (0,1]. For m > 2, using the Geometric-Arithmetic 



Mean inequality we have 



(m — 1)(1 — x)x 



m—1 



< 



(m — 1)(1 — x) + x + X + ... + x' 



m—1 



m 



m 



m 



m—1 



< 1. 



and so m(l — x)x"^ ^ < (^^7^)*" ""^ < 1 which imphes m(l — x)x 
This last inequality is true for m = 1 too. This imphes that 

f'{x) = 2(1 + x"") - 2m(l - x)x"'-^ > 2x'" > 

for all X G (0, 1]. Therefore the function / is strictly increasing and because 
/(1/2) = — 27?r < and /(I) = 1 > 0, by the Intermediate Values Theorem 
there must be an unique solution x = tm, of the equation /(x) = in 

the interval (1/2,1). Because f{tm-i) = ( Y\ZZ\ ) C-i > we see that 



4 



tm < tm-i for all m > 2. Since {2tm — 1)(1 + t™) = we can let m go to 
infinity in this equality and obtain tm 1/2. ■ 
Using Maple, we got some numerical values for the sequence tm- ti = 
« 0.707, t2 ~ 0.648, ts ^ 0.583, t^ « 0.539 and for instance iio ~ 0.5005. 



Proof of Theorem [2l First let us check that Ei = E + I = {l,n} 
and B are independent. Since Ei f] B = {1}, P({1}) = = 1 — r 

and Pr{Ei) = ^—^{r + r") = (1 — r)(l + r"-~^), we have to show that 
Pr{B) = We have 

which is what we needed. Now, suppose b € B and consider Ef, = E + b = 
{b,b + n — l}. We notice that by the definition of B, the intersection BnEh 
is {b}. Hence, Pr{B n Eb) = = (1 - (with c = 6 - 1) and 

Pr{B)Pr{Eb) = 3-^^ (r' + r^+-) = (1 - r)r^ 
Hence, and Ef, are independent for every b (z B. 

Next we would like to observe that if {Fi,B) and {F2,B) are 
independent pairs of events and Fi f] F2 = 0, then Fi U F2 and 
B are independent events as well. 

Indeed, by the given assumption we can write 

Pr{B n (Fi u F2)) = Pr{{B n Fi) u{Bn F2)) = Pr{B n Fi) + Pr{B n F2) = 

Pr{B)Pr{Fi) + Pr{B)Pr{F2) = P,(S)(P,(Fi) + ^.(Fa)) = P,(P)P,(Fi U F2) 

In fact, the above statement can be generalized to a sequence of sets 
Pfc which are pairwise disjoint, due to the fact that Pr is a genuine finite 
measure and so it is continuous (from below and above). Then if T C i? is 
nonempty, A = E + T = |Jf,e_B countable union and since Ei, fl Ey = 
for all b,b' (z B (b b') the above observation can be applied to {Fb}bgT- 
So, we get that B and A are independent. 

For the converse, we need the following lemma. 



\i=0 / 



r-2ra 



1 + r'^ 
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Lemma 2. If L C 'NqXB and the smallest element of L is s = {2i — l)m+j, 
where i,j € N, j < m, then 

J2im 

Pr{L) < - . 

Proof of Lemma [2] Indeed, we have 



Pr{L) < ^[{r' + r'+^ + ... + r^*™) + (r(2»+iWi + ....)] = 



■ 

So, let us assume that r < t^; is as in ([2]) and A is independent of 
B. We let T be the intersection of A and i? and we put a := Pj.{T) / Pr{B). 
Also, define A' := r+{0,n-l}, L = A\A' and L' = A'\A. We have clearly 
L, L' C \ B . By the first part of our theorem Pr{A') = a. Because A and 
B are independent Pr{A) must be equal to a as well. Hence Pr{A) = Pr{A') 
which attracts 

^r'= = ^r^^ r'= = 2^r^ (3) 

fceL' fceL fceLuL' fceL' 

Prom ([3|), it is clear that L' = if an only if L = and so if L' is 
empty then A = A' , which is what we need in order to conclude our proof. 
By way of contradiction, suppose L' 7^ (or equivalently L 7^ 0) we can 
assume without loss of generality that L' contains the smallest number of 
L' L) L, say s which is written as in Lemma El Thus from equality ([3]) we 
have Pr{LUL')> 2Pr{L') and then by Lemma [2] we get 



r^~^ > 2(1 - r)r^"' 44> 2r > H <^ 2r > H . 

Therefore for every n and 1 < j < m, 

2r > 1 + — > 1 + — ^ fir) = (2r - 1)(1 + r"") - r™ > 0. 

By Lemma [1] we see that r > tm which is a contradiction. It remains 
that L and L' must be empty and so A = A' . ■ 

In the previous theorem, since T was an arbitrary subset of an infinite 
set we obtain an uncountable family of pairs of independent sets. 
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Remark 1: If r = where (f) stands for the classical notation of 

the golden ratio (i.e. (p = "^^%^)) n = 2, B = {1,3,5,7,...} as in and 
A = {1,4,6}, then one can check that Pr{B) = j^, Pr{An B) = 1 - r, 
Pr{A) = (1 - r)(l + r3 + r^). So the equality PriA D B) = Pr{A)Pr{B) 
is equivalent to 1 + r = 1 + + which is the same as + — 1 = 0. 
One can easily see that this last equation is satisfied by r = y^. Hence A 

and B are independent but clearly A is not a translation of {0, 1} with a 
subset of B. Therefore the converse part in Theorem [T] cannot be extended 
to numbers r > tm such as r = ^J^- In fact, we believe that the constants 
tm are sharp, in the sense that for all r > tm the converse part is false, but 
an argument for showing this is beyond the scope of this paper. 

Remark 2: Another family of independent events which seems to have 
no connection with the ones constructed so far is given hy A = {1, 2, 3, 4, n- 
l,n} and B = {n, 2n, 3n, ...}, with n G N. A natural question arises as a 
result of this wealth of independent events: can one characterize all pairs 
(A, B) which are independent regardless the value of the parameter r? 



3 Three independent events 

The next theorem deals with the situation in which two sets as in the con- 
struction of Theorem [2] form with B given by dJ]), a triple of independent 
sets. 

Let us observe that if Ai, A2, and B are mutually independent then by 
Theorem [2] (at least if r G (0, tm)), Ai and A2 must be given hy Ai = Ti + E 
with TiC B,i = l, 2. Therefore AinA2 = (Ti n T2) + E. 

Also, we note that Pr{Ai) = Pr(Ti){l + r"~^), i = 1,2, and Pr{Ai n 
^2) = Pr(Ti n T2)(l + r"-i). This means that the equality P,.(Ai (1 A2) = 
Pr{Ai)P{A2) is equivalent to 

PriTi n T2) = Pr{Ti)Pr{T2){l + r""!). (4) 

On the other hand the condition Pr{Ai n n 5) = Pr{Ai)Pr{A2)P{B) 
reduces to 

PriTi n T2) = Pr{Ti)Pr{T2){l + r""l)2p,(B), 

which is the same as (j4]). So, three sets Ai, A2 and B are independent if 
and only if ^ is satisfied. Let us notice that the condition (jl]) may be 
interpreted as a conditional probability independence relation: 
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Pr{T,nT2\B) = Pr{n\B)Pr{T2\B). (5) 

At this point the construction we have in Theorem [2] can be repeated. 
As a result, regardless of what r is, we obtain an uncountable family of there 
events which are mutually independent in (Nq,^, -Pr). 

Theorem 3. For a fixed n > 3, we consider B as in and pick b G 
{2, ...,n — 1} such that 2(6 — 1) divides m = n — 1 (m = 2(6 — l)k). For 
F ■= {0,6-1}, we let 



B[ := {1, 2, 6 - 1, 26 - 1, 26, 36 - 3, 46 - 3, 46 - 2, 56 - 5, 

b-l 



b-l 



b-l 



.,(2fe-2)(6-l) + l,...,(2fc-l)(6-l)}. 



(6) 



b-l 



Bi := B[ U {B[ + 2m) U {B[ + 4m) U {B[ + 6m) U ... 

and T a subset of Bi. Then Ti := F+T and Bi are independent sets relative 
to the induced probability measure on B. Moreover, Ai := Ti + {0,n — 1}, 
A2 '.= Bi + {0,n — 1} and B form a triple of mutually independent sets in 
{No,A,Pr) for allr. 

Proof. The second part of the theorem follows from the considerations we 
made before the theorem and from the first part. To show the first part we 
need to check (jH for Ti and T2 = Bi. Let us remember that 

B = {l,2,...,n — l,2n — 1, 2n, 3n — 3, 

^ V ' ^ V ' 

n—1 n—1 

4n - 3,4n - 2, ...,5n - 5, ...}, and Pr{B) = j^^. 

s ^ ^ l-Tf 

n-1 

We observe that B[ C {1, 2, n — 1} and so Bi C B. Let us first take 
into consideration the case T = {!}. Since Ti = {1, 6} we get Ti nT2 = {1}, 
P^(ri) = (1 - r)(l + r*-i), and 

P^{Bi) = Pr{B'^){l + r^"" + r^"" + r^™ + ...)- ^'^^^^^ 



So, it remains to calculate Pr{B[): 
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(1 - r'-')—-^ = -r—j-T Pr{B 



]^ _ ^2{b-i) l + r*-i ^' (1 + + r"^). 

This shows that (jH) is satisfied. In the general case, i.e. T an arbitrary 
subset of we proceed as in the proof of Theorem [TJ ■ 



4 Uncountable sequences of independent events 

In [10], Szekely and Mori give an example of an infinite sequence of inde- 
pendent sets in (Nq, .4, Pi/2)- Given an infinite sequence of independent sets 
{An}n we may assume that Pr{A]^) < i and so by Proposition 1.1 in [TU] 
we must have 

oo 

J2Pr{Ak) < OO. 

fc=l 

Let us observe that Theorem [2] can be applied to a different space now 
that can be constructed within B given by ©in terms of classes: Nq = 
{6, 1,2, ...} where = 0, i := {1, 2, n - 1}, 2 := {2n - 1, 2n, 3n - 3}, 
3 := {4n — 3, 4n — 2, 5n — 5}, and the probability on this space is the 
conditional probability as subsets of B. 

Hence for A: E N, one can check that 

1 _ „2m 

P{k) = r^^"^, with m = n-l. 

This shows that this space is isomorphic to (Nq,^, -P^) with s = r^™". 
One can check by induction the following proposition. 

Proposition 1. Let n € N, n > 2. If Ai,...,An are independent in Nq then 
Ai +T, A2 + T,..., An + T and B are indepenedent in (No, A,Pr)- 

This construction can be then iterated indefinitely giving rise of a se- 
quence B, Bi, B2,-.-, which is going to be independent and its construction 
is in terms of a sequence {n,ni,n2, ■■■) with > 2. As a result, we have 
a countable way of constructing sequences of independent sets. This con- 
struction coincides with the one in [TOj if = 2 for all A; G N. 
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